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Abstract 

The goal of the present paper is to highlight the fundamental differences of so-called 
synchronization or consensus algorithms when the agents to synchronize evolve on a compact 
homogeneous manifold (like the circle, sphere or the group of rotation matrices), instead of a 
vector space. For the benefit of understanding, the discussion is restricted to the circle. First, 
a fundamental consensus algorithm on R" is reviewed, from which continuous- and discrete- 
time synchronization algorithms on the circle are deduced by analogy. It is shown how they are 
connected to Kuramoto and Vicsek models from the literature. Their convergence properties 
are similar to vector spaces only for specific graphs or if the agents are all located within a 
semicircle. Examples are proposed to illustrate several other possible behaviors. Finally, new 
algorithms are proposed to recover (almost-)global synchronization properties. 



1 Introduction 

During the last decades, synchronization phenomena have attracted the attention of numerous 
researchers from various fields. Many recent engineering applications consider swarms of agents 
that combine their efforts in a coordinated ("synchronized") way to achieve a common task, e.g. 
distributed exploration [TS] or interfcrometry [Tl I16j. From a modeling and analysis viewpoint, 
collective phenomena are studied by both the theoretically oriented communities of dynamical 
systems and statistical physics, as well as more practically oriented experimental physics and 
biology communities (see e.g. [3 [14j [30l [32]). Celebrated examples of simplified models for the 
study of coordination phenomena include Kuramoto and Vicsek models. 

Kuramoto model is proposed in [14] to describe the continuous-time evolution of phase variables 
in a population of weakly coupked oscillators. Each agent k is considered as a periodic oscillator 
of natural frequency u) k , whose phase — i.e. position on its cycle — at time t is 9 k (t) € S 1 . In 
addition to its natural evolution, each agent is coupled to all the others: 

N 

p k =uJ k +Y, sin^j --0 k ) , k=l,2,...,N. (1) 

fe=l 

Vicsek model is proposed in |32j to describe the discrete-time evolution of interacting particles 
that move with unit velocity in the plane. In the absence of noise, the model writes 

r k (t+l) = r k (t) + e i6 ^ (2) 

9 k (t + l) = argj e^W+e^Wj, k = 1, 2, TV , (3) 

yen fc (t) / 

where 9 k denotes the heading angle of particle k and r k its position in the (complex) plane. The 
set n k (t) is defined to contain all agents j for which || rfc(i) — rj(t)|| < R for some fixed R > 0, 
such that agent k is only influenced by "close enoug h" fellowfl 

dotation denotes the complex norm of z £ C, such that z = \\z\\ e l ar s( z ) . The present paper uses the 
convention that arg(0) can take any value on S 1 . It canonically identifies C = K 2 , yielding \\z\\ = V z T z for z S R 2 . 



In the engineering community, synchronization has focused on several basic problems. One of 
them is for a set of agents to reach agreement on some "quantity" — e.g. a position, velocity,. . . — 
while exchanging information along a limited set of communication links. This so-called consensus 
problem has been extensively studied for quantities on the vector space M. n , see e.g. [21 [T71 [T51 1201 
[2T1 [UJ and [TJJ] for a review; related results are briefly explained in the next section. However, 
it appears that many interesting engineering applications and phcnomcnological models, e.g. as 
presented above, involve nonlinear manifolds; this includes distributed exploration of a planet 
(sphere S 2 ), rigid body orientations (special orthogonal groups 5*0(2) or SO (3)), and collective 
motion on limit cycles (abstracted as a circle S 1 ). 

Vicsek and Kuramoto models illustrate two general types of problems for synchronization on 
manifolds. In Vicsek model, stabilizing parallel motion requires equal orientations of the agents, 
which comes down to reaching agreement on states 9k on the circle. In Kuramoto model, moving 
with fixed relative phases corresponds to reaching agreement on a motion on the circle. On multi- 
dimensional manifolds, coordinated motion becomes more complex than on S 1 where it simply 
comes down to reaching agreement on a frequency in R; this is the subject of [52]. The present 
paper focuses on state agreement, more commonly called synchronization. 

Definition 1.1: A swarm of N agents with states Xk(t) € M. evolving on a manifold M., k = 
1,2, ...,N, is said to asymptotically synchronize or reach synchronization if 

X\ = x% = ... = Xjsi asymptotically. 

The asymptotic value of the Xk is called the consensus value. 

The circle is probably the simplest nonlinear manifold to highlight the specifities of synchro- 
nization on highly symmetric compact nonlinear spaces. Therefore the present paper focuses on 
the circle and mentions extensions to manifolds at the end. An important aspect is to maintain 
the symmetry of the synchronization problem: the behavior of the swarm must be invariant with 
respect to a common translation of all the agents (i.e. on S , under the transformation 9k — > 9k + a 
Vfc £ V); therefore extensions consider manifolds on which "all points are equivalent" — formally, 
compact homogeneous manifolds like S n , SO(n) or the Grassmann manifolds. In order to concen- 
trate on fundamental issues of synchronization and geometry, system dynamics are simplified to 
first-order integrators. 

The paper is organized as follows. Section [2] briefly reviews a fundamental algorithm for 
synchronization on vector spaces, also known as a "consensus algorithm" , in continuous- and 
discrete-time. Section [3] extends this algorithm to the circle and highlights its link with Kuramoto 
[Hj and Vicsek [32] models. Section 0] reviews the positive synchronization properties of these 
algorithms. Section illustrates the fact that, in contrast to vector spaces, convergence to non 
synchronized behavior is possible on the circle. Section [6] presents three recently proposed algo- 
rithms for (almost-) global synchronization on the circle: a modified coupling function, a gossip 
algorithm where agents randomly select or discard information from their neighbors, and an al- 
gorithm based on auxiliary variables. Section [7] briefly mentions extensions of the framework to 
compact homogeneous manifolds. General notations and background information about graphs 
can be found in the Appendix. Proofs are summarized to their main ideas; complete versions can 
be found in corresponding references and in [25j . 

2 Consensus algorithms on vector spaces 

The study of synchronization on vector spaces is a widely covered subject in the systems and 
control literature of the last decade. The material in the present Section is a summary of basic 
results developed in this framework by several authors, including [2] [T71 [TH1 [201 [2JJ [3T] ; see [JJ5] 
for a review and [18] for some examples of applications. 
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Consider a swarm of N agents with states x k £ R™, fc 6 V = {1, 2, N}, evolving under 
continuous- time dynamics 

f t x k (t)=u k (t) , k = l,2...,N (4) 

or discrete-time dynamics 

a>*(t + l) =x k (t)+u k (t) , k = l,2...,N (5) 

where u k is a coupling term. The goal is to design u k such that the agents asymptotically syn- 
chronize in the sense of Definition lllll with the following restrictions. 

1. Communication constraint: u k may only depend on information concerning agent k and the 
agents j ~~» k sending information to k according to some imposed communication graph G 
(see Appendix). 

2. Configuration space symmetry: the behavior of the coupled swarm must be invariant with 
respect to uniform translation of all the agents: defining y k (0) = x k {0) + a Vfc £ V for any 
o G K™, it must hold y k (t) = x k (t) + a Vfc £ V and Vi > 0. Therefore u k may only depend 
on the relative positions of the agents, i.e. on (xj — x k ) for j k. 

3. Agent equivalence symmetry: all the agents in the swarm must be treated equivalently. This 
implies that (i) the form of u k must be the same Vfc € V and (ii) all j k must be treated 
equivalently in u k . 

This problem is traditionally called the consensus problem on a vector space. On manifolds, the 
term "synchronization problem" is preferred because the term "consensus" can be given a partic- 
ular meaning different from synchronization, see [53]. On vector spaces, "consensus" as defined in 
[23j is equivalent to synchronization, so both terms can be used interchangeably. 

The consensus problem on vector spaces is solved by the linear coupling 

N 

u k (t) = a ^a 3k (t)( Xj (t)-x k (t)) , k = 1,2..., N (6) 

3=1 

where a,j k is the weight of link j k and a is a positive gain. The intuition behind © is that 
each agent moves towards its neighbors, in agreement with the traditional meaning given to a 
"consensus" process. In continuous-time, the closed- loop system (JU),© implies that agent k is 
moving towards the position in 1" corresponding to the (positively weighted) arithmetic mean of 
its neighbors, -pj aj k Xj, where in-degree d^ = ^2j^ k djk- I n discrete-time, a must satisfy 

ad k l \t) < b for some constant b < 1, Vfc € V. Then ([!]), © means that the future position of 
agent fc is at the (positively weighted) arithmetic mean — ^~ii)(^2i~^ k a jkXj+f3 k x k ) of its neighbors 

j ^> fc and itself, with non- vanishing weight f3 k . 

Clearly, $Q satisfies the three constraints mentioned above. 

The convergence properties of the linear consensus algorithm on a vector space are well char- 
acterized. An extension of the following basic result in the presence of time delays can be found 
in j2U]; the present paper does not consider time delays. 

Proposition 2.1: (adapted from \17\ [751 Wlh [57] /) Consider a set of N agents evolving on 1" 
according to (continuous-time) 0) with a > or according to (discrete-time) (SJ), 0) with 
ad k (t) G [0,6] Vt > and Vfc € V, for some constant b G (0, 1). Then the agents globally and 
exponentially converge to synchronization at some constant value x £ W 1 if and only if the commu- 
nication among agents is characterized by a (piecewise continuous) 6-digraph which is uniformly 
connected. 

If in addition, G is balanced for all times, then the consensus value is the arithmetic mean of 
the initial values: x = -h 2fc=i x k(0). 

Proof idea: For the first part, see [III [18], or equivalently [2] or [31]. For the second part, it is 
easy to see that for a balanced graph, X]fc=i x k(t) is conserved over time. The conclusion is 
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then obtained by comparing its value for t = and for t going to +00. 



□ 



The proof of Proposition 121 1 1 essentially relies on the convexity of the update law: the position 
of each agent k for t > r always lies in the convex hull of the Xj(r), j — 1, 2, N. The permanent 
contraction of this convex hull, at some nonzero minimal rate because weights are non- vanishing, 
allows to conclude that the agents end up at a consensus value. An obvious negative consequence 
of Proposition 121 II for non- varying G is that synchronization cannot be reached if G is not root- 
connected. 

If interconnections are not only balanced, but also undirected and fixed, then the linear con- 
sensus algorithm is a gradient descent algorithm for the disagreement cost function 

JV JV 

V vcct (x) = i^^a jfc ||a;j -a; fc || 2 = \\(B® I n )x\\ 2 = x T (L®I n )x (7) 

k=lj=l 

where ||z|| denotes the Euclidean norm V z T z of z G R m , B and L are the incidence and Laplacian 
matrices of G respectively (see Appendix), x G M. Nn denotes the vector whose elements (k— l)n + 1 
to kn contain Xk, and ®I n is the Kronecker product by the n x n identity matrix. 

3 Consensus algorithms on the circle 

Consider a swarm of TV agents with states on the circle S 1 . The global topology of the circle 
is fundamentally different from vector spaces, because if 9k denotes an angular position on the 
circle, then du + 2tt = 9k, that is, translations on the circle are defined modulo 2n because they 
correspond to rotations. This difference in topology, imposing a non-convex configuration space, 
fundamentally modifies the synchronization problem. 

The synchronization problem on S 1 is considered under the same agent dynamics as on R ra , 
i.e. flU) or <[!|) with Xk replaced by 9k- However, for the design of Uk, the different topology induces 
different implications of the configuration space symmetry. The behavior of the swarm must (i) be 
invariant with respect to a uniform translation of all 9k and (ii) be invariant with respect to the 
translation of any single 9k by a multiple of 2tt — i.e., if (^(0) = 0fc(O) + 2a7r for some k G V and 
a G Z, and ^(0) = 0j(O) Vj ^ k, then it must hold <j> k {t) = 9 k (t) + 2an Vi > and 4> 3 (t) = 9 3 (t) 
Vj 7^ k and Vt > 0. This implies that Uk may only depend on 2it -periodic functions of the relative 
positions (9j — 9k) of the agents j ~* k. The simple linear algorithm does not satisfy the 
periodicity required for configuration space symmetry, and therefore cannot be used on the circle. 
It can however be used to derive algorithms for synchronization on S 1 that are similar to © when 
all agents are within a small arc of the circle. The discrete-time and continuous-time cases are 
treated consecutively. Because of the symmetry with respect to uniform translations on S , the 
swarm's behavior is entirely characterized by examining the evolution of relative positions. 

Definition 3.1: A configuration is a particular set of relative positions of the agents. Thus a 
configuration is equivalent to a point (§1, #2, 9n) € S 1 x S 1 x ... x S 1 and all the points obtained 
by its uniform rotations (9\ + a, #2 + a, ...,9n + a) for a G S 1 . 

3.1 Discrete-time 

Synchronization of 9k G S , k = 1,2, N , can be seen as synchronization of Xk G IR 2 under 
the constraint \\xk\\ = I. If the Xk were not restricted to ||xfe|| = I, algorithm ([5j> , dSJ) would 

impose Xk(t + I) = — (X^^Li a jk Xj(t) + (3k Xk{t) ) , k = 1,2, N , with some non-vanishing 

0kif) > 0. With this update law, Xk{t + 1) does generally not satisfy ||xfc(f + l)j = 1. To obtain 
\\xk(t + 1)|| = 1, the result of algorithm ([!]), © is projected onto the unit circle. Identifying 
R 2 = C, such that a position on the circle is characterized by e i6lfc , leads to the discrete-time 
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synchronization algorithm 



iV 



e (f + l)=arg [5> 3 - fc e"'W +/3e^« ] , fc = 1,2,..., JV, 



(8) 



for some constant /3 > 0. The update of one agent according to ([5]) is illustrated on Figure [TJ It 
is clear from the picture that respects the geometric invariance of S 1 . This is confirmed by 
rewriting (|5j) as 

6 k (t + 1) = 9 k (t) + u k = 6 k {t) + arg ^ a jk e ^(*)-**«) + /A , k = 1,2, TV (9) 
where u k indeed only involves 27r-periodic functions of relative positions of connected agents j k. 




p k := l.5e Wk +e ldl + e 102 



Figure 1: Illustration of update law ([8]) for one agent k with /3 = 1.5 and ai k = a,2 k = 1. 

For fixed undirected G, the point 9 k (t + 1) obtained from © is the projection on the unit circle 
of a point obtained by gradient descent for V vcc t in the complex plane. 

Vicsek model: Heading update law (J3]) actually corresponds to ([H]) with (3 = 1 and aj k E 
{0, 1}. The positions define the interconnection graph G(i) by imposing cij k — 1 if and only if 
||?~fc(i) — < R\ therefore G is called a proximity graph. The study of proximity graphs, or 

other state-dependent graphs, is beyond the scope of the present work. 

3.2 Continuous-time 

Taking the continuous-time limit of (JS|) amounts to letting (3 grow indefinitely. In this limit case, 
Xk(t + 1) G C is defined with an infinitesimal gradient step for V vect , and projected onto S 1 to 
yield 9 k (t + 1). This is strictly equivalent to projecting the gradient of Vvect onto the tangent to 
the circle at k (t) 7 and taking a corresponding infinitesimal descent step along the circle. Thus by 
viewing Vvect a function of 8, renamed for clarity 



N N 

Kirc(0) = !£EM e ^'- 
fc=l j=l 



N N 

id k \\2 \ \ ^ 



2 2j2^ (2sin(^) 

k=l ] = 1 



(10) 



the corresponding gradient descent algorithm along the circle, -^9 k = — a a ^g' fc rc Mk £ V with 
a > 0, is the continuous-time limit of ([5]). Computing the gradient of (jTOJ) yields the following 
continuous-time algorithm for synchronization on the circle, with constant a > 0: 



N 



f t 9 k =a J2( a jk(t)+a k] (t)) siniOj (t) - 9 k (t)) , k=l,2,...,N 



(11) 
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This algorithm can only be implemented for undirected G. An extension to directed graphs is 



N 

£6 k = 2a Y, a ik(t) em(0j(t) - 9 k (t)) , k = 1, 2, N . (12) 

j'=i 

This is the actual algorithm considered in the following. It satisfies the geometric invariance of 
S 1 , since the right-hand side is a 27r-periodic function of relative positions. With x k = e lSk , (fT2j) 
is equivalent to 



N 

dt x k = 20-Proj^ I ^ a jk (xj - x k ) ] (13) 



where Vro] Xk {r k ) = r k — x k x\r k denotes the orthogonal projection of r k € C = M 2 onto the 
direction tangent to the unit circle at x k = e %9k . The geometric interpretation is that Q13p defines a 
consensus update similar to (@|,([6|) but constrained to the subset of K 2 where ||xfc|| = 1. Algorithm 
(|12[) was proposed in |28j in a control framework, and is directly linked to Kuramoto model. 

Kuramoto model: Comparing with (TT|), algorithm (TT2"]) in fact corresponds to Kuramoto model 
with equal natural frequencies lo\ = L02 = ... = ujn, but general interconnections. This highlights 
a link between the sine-model of Kuramoto and the "averaging" update law for headings in Vicsek 

model. For the complete graph, V ciTC = f Ef=iEli ll e ^ " = N 2 - ^ =1< 



The quantity 



E 



3- 

N 

fe=l 1 



e- 



known as the "complex order parameter" in the context of Kuramoto 

model, has been used for decades as a measure of the synchrony of phase variables in the literature 
on coupled oscillators. 

The main point in studies of Kuramoto model is the coordination of agents having different 
io k . The important issue of robustly coordinating agents despite their different natural tendencies 
is not the subject of the present paper. 



4 Convergence properties 

Section [3] proposes algorithms ||HJ) and (|12p as natural extensions of synchronization algorithms 
for the circle. However, the circle is not a convex configuration space. As a consequence, the 
convergence properties of (© and (fT2"|) do not match those of ((I]),© and jS]),© on vector spaces. 
The present Section focuses on positive convergence results, while Section [5] focuses on situations 
in which asymptotic synchronization is not achieved. 



4.1 Local synchronization like for vector spaces 

When all agents are within a small subset of S 1 , (fT2"]) becomes similar to ((H), © because sin(#j — 
9 k ) ~ (9j — 9 k ) for small (9j — 9 k ). A similar observation can be made for the discrete-time algo- 
rithms. It is thus not surprising that [12 HE] are able to show that asymptotic synchronization on 
the circle is locally achieved under the same conditions as on vector spaces. 

Proposition 4.1: (adapted from \18)/ ) Consider a set of N agents evolving on S 1 according to 
(continuous-time) lilty) with a > or according to (discrete-time) with (3 > 0. If the communi- 
cation among agents is characterized by a (piecewise continuous) 5-digraph G which is uniformly 
connected and all agents are initially located within an open semicircle, then they exponentially 
converge to synchronization at some constant value 9 E S 1 . 

Proof idea: Assume without loss of generality that 9 k € [— b, b] C (— 5, ^) initially. Then.sin(0fc(t)— 
= c 3k {t){9,j{t) - 9 k (t)) where c jk (t) > > depends on (9j(t) - 9 k (t)). Thus JT2J is 
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equivalent to 



N 

f t 6 k = a^aMt) c jk (t) (0j(t) - k (t)) 

3=1 



(14) 



for some time-varying Cjk > 81 " 2fe > 0. This can be viewed as a linear synchronization algorithm 
for 9 € R with a ^-digraph G2 of weights (ajkCjk). A similar idea can be used in discrete-time. □ 

When the agents are distributed over more than a semicircle, the proof of Proposition 14111 
no longer holds, because the Cj% can be negative. This is in fact the consequence of a loss of 
convexity, implying that the strong vector space arguments of |17[ 118] are no longer applicablqj. 
In algorithms (JSj) and (fl"2|) . agents move on the shortest path towards their neighbors. Therefore, 
if the agents are initially located within a semicircle, then they remain within this set for all future 
times, while agents distributed over more than a semicircle may, a priori, leave any open arc s € S 1 
containing them all. A more global analysis requires stronger assumptions. 



4.2 Some graphs ensure (almost) global synchronization 

For general graphs, synchronization is only locally asymptotically stable. For some graphs how- 
ever, synchronization is (almost) globally asymptotically stable. 

Proposition 4.2: (adapted from |7| \29f) Consider a set of N agents evolving on S 1 by applying 
\12\ ) with a > or @) with (3 > not too small (see Propositions 151,21 and \513\ in the following 
section). If communication graph G is either a fixed directed root- connected tree, or an undirected 
tree, or the complete graph, or any vertex-interconnection of trees and complete graph^, then the 
agents asymptotically converge to synchronization, for almost all initial conditions. 

Proof idea: For the directed rooted tree, each agent is attracted towards its parent and, except 
for unstable situations where two connected agents are exactly at opposite positions on the circle, 
they synchronize at the initial position of the root. The particular undirected graphs have the 
property that synchronization is the only local minimum of V^i rc . This is rather obvious for the 
tree, from the fact that for any pair of connected agents, variations of V c i rc can be built involving 
only the distance between that particular pair of agents. The property is proved for the complete 
graph in [55]. Finally, [3j shows that the property holds for vertex- interconnections of graphs for 
which it holds individually. Then Propositions l5IHI5l2l andl 5l3l of the following section ensure that 
synchronization is the only stable limit set. □ 



5 Obstacles to global synchronization 

Section |4] identifies situations where ([8]) and (fT2|) converge to synchronization. The present section 
examines what can happen when this is not the case. 

5.1 Convergence to local equilibria for fixed undirected G 

The fact that for fixed undirected G, (|12[) is a gradient descent for V C i rc , has strong implications 
for the convergence analysis. 

Proposition 5.1: Consider a set of N agents evolving on S 1 according to \12\) with a > 0, 
with communication graph G fixed and undirected. Then the agents always converge to a set of 

2 An open subset s C S 1 is convex if it contains all shortest paths between any two points of s. 

3 A vertex-interconnection of two graphs Gi (Vi , E\ ) and G2 (V2 , £2 ) is a graph G whose vertices can be partitioned 
into a singleton {k} and two sets V a , V;, and whose edge set can be partitioned into two sets £ a , £(,, such that 
V a U {k} = Vi, £ a = £1, V b U {k} = V 2 and £ b = £ 2 . 
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equilibria corresponding to the critical point^ of V c - uc defined in \10\) . The only asymptotically 
stable equilibria are the local minima of V C i TC . 

Proof idea: Properties of gradient algorithms. □ 



For the discrete-time algorithm, in addition to a result similar to Proposition 15111 but with a 
bound on /3, it can be shown that under locally asynchronous update, convergence holds for arbi- 
trary (3, i.e. without requiring any minimal inertia. Agents are said to update synchronously if, 
between instants t and t+1, all agents k G V apply (J5J). In contrast, agents are said to update locally 
asynchronously if, between instants t and only a subset of agents a C V applies ((H)) and the 

others remain at their position, and set a contains no agents that are connected to each other in G. 

Proposition 5.2: (from \2$ ) Consider a set of N agents evolving on S 1 by applying [Sty locally 
asynchronously with update subset sequence o~(t), for (3 > and fixed undirected G. Assume that 
there exist a finite time span T and a partition of the discrete-time space [to,t±) , \b\,t2),... with 
(tn+i — t n ) < T Vn G Z>o, such that Vfc G V and Vn G Z>o, there exists t G [t n ,t n +i) such that 
k G o-(t). Then the agents almost always converge to a set of equilibria corresponding to the critical 
points ofV c i lc . The only asymptotically stable equilibria are the local minima ofV c i TC . 

Proof idea: Under the assumptions of the Proposition, denoting ^2j=i ajk^ Si ~ Sk ^ + (3 = Pke lUk , 
V ciic (t + 1) - V ciic (t) = -2 J2 (P* + P) ( sin ( l -f)) 2 < • 

Since every agent k is updated at an infinite number of time instants, u k or pk (making Uk unde- 
fined) must go to when t goes to +oo, Vfc G V. The case pk = has zero measure and can only 
appear "by chance" , because it is the global maximum of V c i rc with respect to Ok ■ If Uk goes to 
0, then agent fc asymptotically approaches an equilibrium set; only minima can be asymptotically 
stable for a descent algorithm. □ 

For synchronous update, it is again necessary to impose a bound on the motion of the agents. 
However this bound is not easy to find. The following result provides a conservative bound on /3. 

Proposition 5.3: (from 1241) Consider a set of N agents evolving on S 1 by applying syn- 
chronously with fixed, undirected and unweighted G. Assume that 



13 > d max + 1) where = 1 + fa* 

with d sum = J2f=k an d dmax = maxfcgv(4'')i where is the in- degree of agent fc. Then the 
agents almost always converge to a set of equilibria corresponding to the critical points of V c i rc . 
The only asymptotically stable equilibria are the local minima of V c i rc ■ 

Proof idea: The proof shows that V c i lc (t + 1) — V c i IC (t) < for synchronous operation and the 
bound on (3. See [24] or [25] for complete computations. □ 



A problem with the bound of Proposition 1 513 1 is that each agent must know d sum and d max , 
which is information about the (communication structure of the) whole swarm. 

In the absence of inertia {[3 = 0), (O can lead to a limit cycle in synchronous operation, at 
least for some G (see [25] for an example). 

Hopfleld network: This model proposed in [TT] considers N neurons with states Xk G { — 1,1}. 
The discrete-time update law for the states of the neurons is 

x k (t+l) =sign a jk Xj(t)+^k\ , 1,2,...,7V (15) 



A critical point of a differentiable function / : X — » R is a point of X where the gradient of / is identically zero. 
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where £ fe is a firing threshold. Considering Vh = =^ J2k=i Z)j=i a jk x j x k ~ Z)k=i ^fc 6; > [II] 
shows that when (p~5|) is applied asynchronously with a random update sequence, the property 
Vif(t + 1) < Vjj (t) always holds and the network eventually reaches a local minimum of V#. In 
contrast, the system can go into a limit cycle under synchronous operation (see [TU|). 

Defining the sphere S n of dimension n as {xj; £ M. n+1 : \\xk\\ = 1}, the set { — 1,1} can be 
seen as " S° ", while the circle is S 1 . For = 0, (fT5|) is in fact the strict analog of © for "the 
sphere of dimension 0" — namely moving towards the neighbors in the embedding vector space 
and projecting back to the state space. The absence of inertia in (fl~5|) would correspond to j3 = 
in ([5]). Both and (fT5)) can be viewed as projections of descent algorithms for a symmetric 
quadratic potential, which remain descent algorithms under locally asynchronous update such 
that convergence is ensured. Both algorithms can fail to converge and run into a limit cycle in 
synchronous operation. 

Propositions 15111 15121 and 15131 say that the stable equilibria are the minima of V c irc ■ Unfortu- 
nately, depending on G, there may be local minima different from synchronization. 

Local equilibria for the undirected ring: The following example is taken from [T^. Consider 
N agents interconnected according to an undirected, unweighted ring graph. Then the critical 
points of V^irc satisfy sm(9j a ^ — 9k) + sin(8j b QA — 6k) = where j a (k) and jb{k) are the two 
neighbors of k in the ring graph. This requires positions of consecutive agents in the ring graph 
to differ either by 9o or by it — 9o, for some 9q £ [0, |] well chosen such that the sum of all 
angle differences is a multiple of 27r. Stability of these equilibria can be assessed by examining 
the Hessian of V c i TC . This leads to the conclusion that each configuration with \9j — 9k\ = 9q < ^ 
fc) £ ^ is locally asymptotically stable under (fT2"|) or ((B|) , and all other configurations are 
unstable. Thus in a stable configuration, consecutive agents in the ring graph are separated by 9q 
on the circle, for some 6q £ (— | ) satisfying N9o = 2air with a £ Z. The case 9o = corresponds 
to synchronization. When N > 5, stable configurations exist with 9$ ^ 0, see Figure [5J For all 
these configurations, Y^k=i e%9h ~ 0> therefore they are said to be balanced. 




Figure 2: Several balanced configurations that are stable for the undirected ring graph; agents are 
numbered in the order of the ring, e.g. agent 3 is connected to agents 2 and 4. 

Stable configurations are graph dependent: It is currently an open question to character- 
ize, with graph-theoretic properties, which graphs admit no local minima of V C i IC different from 
synchronization. The following result shows that in fact, any configuration that is sufficiently 
"spread" on the circle is stable under the synchronization algorithms for a well-chosen weighted 
digraph. 
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Proposition 5.4: Consider a set of N agents distributed on S 1 in a configuration {9k} such that 
for every k, there is at least one agent located in (9k, 9k + tt/2) and one located in (9k — tt/2, 9k); 
such a configuration requires N > 5. Then there exists a positively weighted and strongly connected 
6 -digraph making this configuration locally exponentially stable under H2\) with a > 0. 

Proof idea: Choose nonzero weights djk only for the 9j G (9k — n/2,9k + 7r/2), and such that 
Tk '■= J2jLi a jk (xj - x k ) is aligned with x k = e ldk . □ 

For any of the weight choices that locally stabilize specific configurations, synchronization is 
also exponentially stable — but thus only locally. The equilibrium configurations of |HJ an d (|12| 
different from synchronization are formalized in |23j as consensus configurations. The same paper 
also considers the related problem of "spreading" agents on the circle, which is formalized with 
the notions of anti- consensus and balancing configurations. 

Structurally stable divergent behavior in Vicsek model: The above example of stable 
equilibria for the undirected ring allows to illustrate a situation where Vicsek model diverges. 
Consider N > 5 agents initiated as in Figure [3j (i) initial positions r&(0) G M 2 are regularly 
distributed on a circle such that each agent can sense only its immediate neighbor on the left and 
on the right; (ii) initial orientations 9k(0) G S 1 point radially outwards of the circle formed by the 
positions. Then the update equation for agent orientations 9k(t) is exactly in a stable configuration 
different from synchronization under a ring interconnection graph. The agents move radially 
outwards; at a particular time step, all communication links drop. Stability of the equilibrium 
for the orientations and the fact that all communication links still disconnect at the same instant 
when positions arc slightly shifted ensures that the divergent behavior is observed in an open 
neighborhood of initial conditions around this ideal situation. Examining stable equilibria of JSJ) 
and (|12p for G different from an undirected ring, one sees that the stable divergent behavior 
remains if the sensing regions are increased such that each agent initially has several neighbors on 
the left and on the right. 



Figure 3: Initial conditions for divergent behavior in Vicsek model. The black disks denote agent 
positions, arrows denote orientations; the circle represents the sensing region of agent 1. 

5.2 Limit sets different from equilibrium 

Section 15.11 lists cases where (|12|) or ((HJ do not converge to synchronization, but still to a set of 
equilibria. There are also cases where the agents do not converge to a set of equilibria. 

For fixed undirected graphs, the swarm is ensured to converge to a set of equilibria, except for 
the discrete-time algorithm when (3 is too small (see Proposition EE]) ■ In the latter case, behavior 
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Figure 4: Illustration of disorderly-looking quasi-periodic motion of an agent k for which 4r0k = 
Ylj=i sm (#j — Of.) where 9i belongs to a regularly spaced undirected ring, = 0; 62 is in cyclic 
pursuit with 5 other agents, ^82 = V3; 83 is in cyclic pursuit with 11 other agents, ^6*3 = 1. 

of {8} is not as clear and the system may run into a limit cycle; see [24] or [25] for details. 

Periodic and quasi-periodic behaviors can easily be constructed for (|12[) with fixed directed 
graphs. 

The simplest such behavior is called cyclic pursuit: each agent k is attracted by its neighbors 
to move (say) clockwise, and the agents keep turning without synchronizing. A classical situation 
of stable cyclic pursuit is a directed ring graph with consecutive agents separated by ^ . 

In basic cyclic pursuit, agents keep moving on the circle but relative positions remain constant. 
A more meaningful periodic behavior occurs when relative positions periodically vary in time. Such 
situations can be built with agents partitioned into two sets such that each set is in cyclic pursuit 
at a different velocity. Start for instance with two unweighted directed ring graphs of N± and N2 
agents, where JVi + N2 = N and N\ ^ N2; consecutive agents in each ring are separated by 
and j^-. Then the resulting behavior is satisfactory, but the overall graph is not connected. To 
obtain a strongly connected graph, each agent of the first ring can be coupled to all the agents 
of the second ring and conversely; indeed, for a set of regularly spaced agents ^ fc e 10 * 1 = 0, so 
coupling an agent to such a set does not change its behavior. 

Likewise, a quasi-periodic variation of relative positions is obtained when several sets of agents 
move in cyclic pursuit with irrational velocity ratios. This can be built for instance with unitary 
graph weights and a = 1, if one set has x agents in a splay state for an undirected ring graph 

= 0, a second set has 6 agents in cyclic pursuit with a directed ring graph <^> j^dk = V3, and 
a third set has 12 agents in cyclic pursuit with a directed ring graph j^8k = 1. 

Finally, an example of disorderly-looking quasi-periodic motion can be built by adding to the 
previous situation an agent which is influenced by one agent in each of the three rings; the motion 
of this agent is illustrated on Figure 2J 

It is possible to build situations of fixed directed coupling with even more surprising behavior. 
Figure [5] represents the motion of two sets of agents in cyclic pursuit, with coupling among agents 
of the two sets and initial positions such that all the agents periodically revert their direction of 
motion. 

For time- varying graphs, the situation is even more complicated. Since many different configu- 
rations can be stable on the circle depending on G, the swarm can be driven towards different equi- 
libria during longer or shorter time spans, implying no particular characterization of the swarm's 
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Figure 5: Motion of agents applying (fT^|) with fixed directed coupling, such that they all period- 
ically revert their direction of motion. Set A has 9 agents regularly spaced by ^ on the circle. 
Set B has 9 agents also regularly spaced, but initially rotated by ^ with respect to A. In A, 
f t 9 k = 0.04 sm(8j - 6 k ) + 0.05 sin(6> ; - 9 k ) where j is the agent of A for which 9j-6 k = =^, and I 
is the agent of B for which initially 0j - 9 k = ||. In B, f t 6 k = 0.07 sin(6» J - 6 k ) + 0.05 sin(6» z - 6 k ) 
where j is the agent of B for which 6j — 6 k = ^ and I is the agent of A for which initially 
di — k = jg. Top: velocities of the two sets (continuous curve for A. dotted curve for B). 
Bottom: evolution of sin^fc) for all agents k. 
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behavior if G(i) can be arbitrary. In practice, synchronization is often eventually observed. This 
is because synchronization is ensured for connected graph sequences as soon as agents all lie in 
the same semicircle. But other asymptotic behaviors are possible. 

The diversified, poorly characterized behavior of jS} or (fT2"]) with directed and time-varying 
G is in strong contrast with the behavior of the consensus algorithm on vector space, which is 
fully characterized by Proposition 141 1 1 In addition, Proposition 141 II can be extended to the case 
where time delays are present along the communication links (see |20j). while the behavior of {8} 
or (|12p under time delays is still under investigation even for fixed undirected G. Even for the 
complete graph, delays may lead to stable synchronized solutions, stable "spread" solutions, as 
well as periodic oscillations [35] , 

Finally, it must be noted that the graph modeling inter-agent communication often depends 
on the states of the agents, like for instance in full Vicsek model [35] ■ Studying the interaction 
of state-dependent graphs with algorithms that are not specifically designed for particular graph 
behavior is currently a difficult problem, which goes beyond the scope of the present paper. 



6 Algorithms for global synchronization 

Section [5] highlights that consensus algorithms on the circle may exhibit complicated behaviors. 
In a control framework, a natural question is then whether the update rules (JSJ) and (112p can be 
modified to enforce better synchronization properties. 



6.1 Modified coupling for fixed undirected graphs 

For fixed undirected graphs, algorithms |(SJ) and (|12p guarantee convergence to an equilibrium 
set, but stable equilibria different from synchronization may exist. Such spurious equilibria can 
be rendered unstable by reshaping the way agents are attracted towards their neighbors. A 
continuous-time setting is chosen for convenience; a similar result could be developed in discrete- 
time. For simplicity, G is assumed unweighted. 

Consider a continuous- time synchronization algorithm on S 1 of the form 

^0* = 40, k=l,2,...,N. (16) 

3~>k 

The function / : S 1 — > K is called the coupling function. For (|12|) . f(6) = sin(0). Section [Ol 
examines local equilibria of (|12[) for the undirected ring graph and concludes that a configuration 
is stable if interconnected agents are closer than ^ (because 4sf{6) > for \8\ < 5-), and unstable 
if they are further apart than ? (because 4sf{&) < for |0| > If f{9) is modified to have a 
positive slope only up to — for some a > 2, then connected agents must be closer than ^ at a 
stable equilibrium for the ring graph; taking > ^ it becomes impossible to distribute the agents 
as on Figure and synchronization is the only stable equilibrium. This motivates the following. 
Assume (a bound on) the number N of agents in the swarm is available. Define 

f w^(* + °) for0e[-7T,-f] 
9(0) = I a 6 for G [-£,£] (17) 

for some a > 0, extended 27r-periodically outside the above intervals, as represented on Figure El 
Function g(9) is the gradient of (with 27r-pcriodic extension) 

(z(0)) 2 = §0 2 for f] 

{ mw^ + i^i^O- t) for0e[f,vr] 
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which is even, has a minimum for 9 = 0, a maximum for 9 = tt and evolves monotonically and 
continuously in between, similarly to the sinusoidal distance measure (2sin(|)) . 
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Figure 6: The alternative coupling function g. 

Choosing f{9) = g{9) in ()16|) defines a synchronization algorithm which satifies all invariance 
and communication constraints and whose only stable configuration is synchronization for fixed 
undirected G. Rigorously, the edges in g{6) should be smoothed to make it continuously differen- 
tiable everywhere; this changes nothing to the general argument. 

Proposition 6.1: Consider a swarm of N agents, interconnected according to a connected fixed 
undirected graph G, that evolve on S 1 by applying (16\) with f{9) = g{9) defined by (a smoothed 
version of) \1T\ ). The agents always converge to the set of equilibria corresponding to the critical 
points ofV g ~\ ^2k^j~*k ( z (0j ~~ @k)) 2 ■ Moreover, the only asymptotically stable equilibrium is 
synchronization. 

Proof idea: (see [35] for a full proof) The agents always converge to a set of critical points of V g 
because the algorithm is a gradient descent for V g . Synchronization, as the global minimum of V g , 
is stable. Stability of other equilibria is characterized by examining the Hessian of V g . It is shown 
that for the interaction function g(8), if the Hessian is positive semidefinite with eigenvalue only 
in the direction of uniform motion (9^ — * 9^ + a Vfc G V), then the graph G p , containing edge 
{j, k} if and only if j and k are closer than jfr, must be connected. Then all agents must be within 
a semicircle and convexity arguments impose synchronization like on the real line. □ 



6.2 Introducing randomness in link selection 

The modified coupling function solves the problem of spurious local minima in V c i TC . However, 
it may introduce numerous unstable equilibria. Moreover, for varying and directed graphs, the 
behavior of (fTC]) is not better characterized than for (|12|). The present section introduces a so- 
called "Gossip Algorithm" (see [3] and references therein) in order to improve synchronization 
behavior on the circle. Thanks to the introduction of randomness, it achieves global asymptotic 
synchronization with probability 1 for directed and time-varying G. It is described in discrete-time 
for easier formulation. 

The nice convergence properties of §8§ and (fT2"|) when G is a tree motivate to keep the update 
law ([5]), but at each time select at most one of the in-neighbors in G(i) for each agent. In order to 
satisfy the equivalence of all agents, k may not privilege any of its neighbors — it is just allowed, for 
weighted G, to take the different weights of the corresponding edges into account. Always choosing 
the neighbor with maximum weight could disconnect the swarm. Therefore, it is necessary to select 
the retained neighbor randomly among the j ~-> k. A natural probability distribution for neighbor 
selection would follow the weights of the edges, but in theory any distribution with nonzero weight 
on each link is admissible. With the proposed edge selection procedure, the neighbor chosen at 
time t + 1 is independent of the neighbor chosen at time t (up to, for varying graphs, a possible 
dependence of G{t + 1) on G(i)). 

Gossip algorithm (directed). At each update t, 
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1. each agent k randomly selects an agent j ~~> k with probability a^j ((3 + X];~>fc a ik), where 
(3 > is the weight for choosing no agent; 

2. Qk{t + 1) = Oj(t) if agent k chooses neighbor j at time t, and 6k(t + 1) = 0k(t) if it chooses 
no neighbor. 

A variant of the Gossip Algorithm exists in which the random graph is undirected at each time 
step. In this variant, agents have to select each other in order to move by averaging their positions. 
The advantages of this variant on S 1 are not clear, and proving global asymptotic synchronization 
with probability 1 is somewhat more difficult; see for details. 

The directed Gossip Algorithm proposed above is extreme in the sense that agent k directly 
jumps to the position of its selected neighbor. A more moderate directed Gossip Algorithm would 
apply the update law 6 k (t + 1) = arg(a e l6k{t) + e i6 *W) with a > 0. 

The authors of [3] perform a detailed analysis of a Gossip Algorithm for synchronization in 
vector spaces. Convergence towards synchronization is always ensured on vector spaces and the 
problem is to quantify the convergence rate as a function of G and probability (i.e. weights) 
distribution. On the circle, convergence towards synchronization is not obvious a priori, but in 
fact it holds under the same assumptions. 

Definition 6.2: TV agents asymptotically synchronize with probability 1 if for any initial con- 
dition, for any e > and k G (0, 1), there exists a time T after which the maximal distance 
|0fc(T) — 9j(T)\ between any pair of agents is smaller than e with probability larger than n. 

Proposition 6.3: Consider a set of N agents interconnected according to a uniformly connected 
5-digraph G. If the agents apply the (directed) Gossip Algorithm with a fixed finite f3 > 0, then 
they asymptotically synchronize with probability 1. 

Proof idea: (see for a full proof) Consider a set of links forming a directed tree of root k. For 
G(t) uniformly connected, there exists a sequence of link choices, implementable on any time in- 
terval [t,t + T s ] for some finite T s , that builds this tree (and only this tree, potentially selecting no 
move for many time instants!) sequentially from the root to its leaves. This sequence synchronizes 
the agents at the position of the root for any initial conditions. Moreover, its finite length implies 
a finite (though potentially tiny) probability to be selected during any time interval of length T s . 
Therefore when t goes to +oo, the probability that this sequence never appears goes to 0. Since 
it suffices that the sequence appears once to ensure synchronization, this concludes the proof. □ 

The convergence proof of Proposition 16131 can be adapted for the moderate version of the 
directed Gossip Algorithm, with inertia a > 0, as described in [25] . 

Under the initial Gossip Algorithm (inertia-less, i.e. with a = 0), agents in fact jump be- 
tween a discrete set of possible positions corresponding to the initial positions of the TV agents. 
This highlights that the directed Gossip Algorithm can in fact be applied on any set of symbols. 
Proposition 16131 purely relies on the evolution of agents between TV different "symbols", completely 
independently of the underlying manifold. Every time a position is left empty (implying that 
the synchronization process progresses as an agent joins other ones), that position can never be 
reached again in the future; this process goes on until all agents are on the same position after a 
finite time. 

In this context, a natural measure of convergence rate is the expected synchronization time, i.e. 
the average time, over all possible link choices, after which all agents are on the same position. A 
Markov chain framework can be applied to obtain an explicit formula for the expected synchro- 
nization time, at least for fixed graph G, see [25j ; unfortunately, the complexity of the explicit 
formula grows exponentially with the number of agents, and it seems difficult to extract the influ- 
ence of the link choice probability distribution. The expected synchronization time — including 
its numerical value — is independent of S* 1 and independent of the initial positions of the agents 
(unless some agents are initially perfectly synchronized). The only remaining parameters are the 
graph G and the probability distribution. There seems to be an interesting interplay between 
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these two parameters; it is therefore challenging for the agents to optimize their convergence rate 
based on their local information. 

Simulations confirm that the Gossip Algorithm favors global synchronization. However, they 
also highlight that the probabilistic setting can lead to unnecessarily slow convergence rates: often 
a set of agents partitioned into two groups, located at 9 a and 9b respectively, keep oscillating 
between these two positions for an appreciable time before they synchronize on one of them. 

6.3 Algorithms using auxiliary variables 

In the synchronization framework, the non-convexity of 5* 1 can be "cheated" if the agents are able 
to communicate auxiliary variables in addition to their positions on the circle. A different view- 
point on this procedure is that the limited number of communication links for information flow is 
compensated by sending larger communication packets along existing links. Such strategies allow 
to recover the synchronization properties of vector spaces for almost all initial conditions. Their 
potential interest lies more in engineering applications than in physical modeling, where commu- 
nication of auxiliary variables is questionable. In the present paper, the relevant algorithms are 
just briefly mentioned for completeness. 

A first use of auxiliary variables is to build a reduced communication network, in which a 
leader is identified which then attracts all the agents. The leader election / spanning tree con- 
struction would be completely independent of the agents' motion on S 1 and should be achieved 
after a finite time; then applying a synchronization algorithm with this leader / spanning tree 
would ensure synchronization. See [3] for a distributed algorithm that achieves this preliminary 
network construction. Note that for termination of the network construction after finite time, (a 
bound on) the total number N of agents must be available to each agent. Also, it is not clear how 
well the spanning tree construction can be adapted to time- varying graphs. 

A second use of auxiliary variables is to reach consensus on a reference synchronization point: 
an auxiliary variable in R 2 is associated to each agent, and a consensus algorithm is run on these 
auxiliary variables. Each agent individually tracks the projection of its auxiliary variable on S . 
Thanks to the fact that S 1 is equivalent to the Lie group SO(2), this can be implemented in a 
way that satisfies the coupling symmetry hypotheses. For uniformly connected G, the consensus 
algorithm on auxiliary variables defines a point in the plane, and synchronization is ensured for 
almost all initial conditions. See [57j for details and a formal proof. 

7 Generalizations on compact homogeneous manifolds 

Although the discussion in this paper focuses on the circle for simplicity, it is representative of 
more general manifolds. Compact homogeneous manifolds arc manifolds that can be viewed as the 
quotient of a compact Lie group by one of its subgroups. They include the ri-dimcnsional sphere 
S" , all compact Lie groups like e.g. the group of rotations SO(n), and the Grassmann manifolds 
Grass(p, n). 

In [23] , the developments of Section [3] are extended to compact homogeneous manifolds M. 
that are embedded in M. m such that the Euclidean norm ||x|| in R m is constant over x G M. The 
cost function and gradient algorithms are generalized, and an intepretation in terms of moving 
towards an appropriately defined average of positions on M is given. In particular, the cost 
function measures the Euclidean distance between agents in the embedding space, also called the 
chordal distance. Convergence properties are analyzed, and stable local equilibria are formalized 
as consensus configurations. An "opposite" algorithm, in which agents move away from their 
neighbors to spread on the circle, is proposed along the same lines and its convergence properties 
are formalized with anti- consensus and balancing configurations. 

Regarding global synchronization, the results of Section[3]for trees and complete graphs as well 
as agents initially located within convex sets remain valid on more general manifolds. Obstacles 
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like those illustrated in Section [5] appear as well. The modified coupling algorithm of Section 16.11 
should, in principle, have an extension on general manifolds, but the current convergence proof 
is algebraic rather than geometric and cannot be repeated. The (directed) Gossip Algorithm of 
Section 16.21 works on any manifold — in fact even any set; the undirected variant is less easily 
generalized. The algorithm mentioned in Section 16.31 specifying a "reference synchronization 
state" with auxiliary variables, is generalized to compact homogeneous manifolds in [23] (modulo 
the fact that a meaningful communication of auxiliary variables sometimes requires a common 
external reference frame). The same type of algorithm with auxiliary variables can also be used 
for balancing on the circle and on compact homogeneous manifolds. 

8 Conclusion 

The present paper proposes a natural extension of the "consensus" framework, where agents have 
to agree on a common value, from values in vector spaces to values on the circle. This leads to a 
related interpretation of Kuramoto and Vicsek models of the literature. 

Although convergence is similar to vector spaces in some specific situations, in general the 
behavior of consensus algorithms on the circle is much more diversified, allowing local equilibria, 
limit cycles, and essentially any type of behavior when the interconnection graph can vary freely. 

Global synchronization properties can be recovered on the circle (i) by modifying the coupling 
between agents (Section 16. 1|) . (ii) in a stochastic setting where at most one neighbor is randomly 
selected at each time step (Section 16. 2\ , and (iii) less surprisingly, by assisting the agreement 
process with auxiliary variables in a vector space (Section HO]) . 

Several questions remain open to characterize and optimize the global behavior of these simple 
consensus algorithms on the circle; this indicates possible directions of interest for future research. 
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Appendix: Notions of graph theory 

In the framework of coordination with limited interconnections between agents, it is customary to 
represent communication links by means of a graph (see for instance 0E])- 

Definition 8.1: A directed graph G(V,£) (short digraph G) is composed of a finite set V of 
vertices, and a set £ of edges which represent interconnections among the vertices as ordered 
pairs (j, k) with j and k G V. 

A weighted digraph G(V,£,A) is a digraph associated with a set A that assigns a positive 
weight ajk G K>o to each edge (j,k) G £. 

An unweighted graph is often considered as a weighted graph with unit weights. A weighted 
graph can be defined by its vertices and weights only, by extending the weight set to all pairs 
of vertices and imposing ctjk — if and only if (j, k) does not belong to the edges of G. A 
digraph is said to be undirected if a,jk = a^j Vj, k G V. It may happen that (j, k) G £ whenever 
(k,j) G £ Vj, k G V, but djk akj for some j, fc G V; in this case the graph is called bidirectional. 
Equivalently, an unweighted undirected graph can be defined as a set of vertices and a set of 
unordered pairs of vertices. 
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In the present paper, each agent is identified with a vertex of a graph; the N agents = vertices 
are designed by positive integers 1, 2, TV, so V = {1, 2, N}. The presence of edge (j, fc) has the 
meaning that agent j sends information to agent fc, or equivalently, agent k measures quantities 
concerning agent j. It is assumed that no "communication link" is needed for an agent k to get 
information about itself, so G contains no self-loops: (k,k) ^ £ Vfc G V. In visual representations 
of a graph, a vertex is depicted by a point, and edge (j, k) by an arrow from j to k. Therefore a 
frequent alternative notation for (j, k) G £ is j ~^ k. One also says that j is an in-neighbor of k 
and k is an out-neighbor of j. In the visual representation of an undirected graph, all arrows are 
bidirectional; therefore arrowheads are usually dropped. One simply says that j and k are neigh- 
bors and writes j ~ k instead of j ~^ k and k j. The in-degree of vertex fc is dj. = X^jLi 

The out-degree of vertex fc is dj^ = S^Li a fcj- A digraph is said to be balanced if djj, = 
Vfc G V; in particular, undirected graphs are balanced. 

The adjacency matrix A G M. Ny ~ N of a graph G contains Ojfc in row j, column fc; it is symmetric 
if and only if G is undirected. Denote by \£\ the number of edges in G. For a digraph G, each 
column of the incidence matrix B G ({ — l,0,l}) Arx ' £ corresponds to one edge and each row to 
one vertex; if column m corresponds to edge (j, fc) , then 

bjm = -1 , hm = 1 and 6 im = for I £ {j, k} . 

For an undirected graph G, each column corresponds to an undirected edge; an arbitrary orien- 
tation (j, k) or (fc, j) is chosen for each edge and B is built for the resulting directed graph. Thus 
B is not unique for a given G, but G is unique for a given B. 

The in- and out-degrees of vertices 1,2,.. .,7V can be assembled in diagonal matrices 
and Z?W. The in-Laplacian of G is = D^' — A. Similarly, the associated out-Laplacian is 
= Z}(°) — A. For a balanced graph G, the Laplacian L = L^ 1 ' = L^°\ The standard definition 
of Laplacian L is for undirected graphs. For the latter, L is symmetric and, remarkably, L = BB T . 
For general digraphs, by construction, (1n) T L' 1 ' = and ljv = where ljv is the column 
vector of N ones. The spectrum of the Laplacian reflects several interesting properties of the 
associated graph, specially in the case of undirected graphs, see for example [5]- In particular, it 
reflects its connectivity properties. 

A directed path of length / from vertex j to vertex fc is a sequence of vertices vq, v i, vi with 
vq = j and vi = k and such that (w m ,w m +i) G £ for m = 0,1,..., 2 — 1. An undirected path 
between vertices j and fc is a sequence of vertices vq, v±, vi with t>o = j and vi = k and such 
that (v m ,v m+ i) G £ or (v m+ i, v m ) G £ , for m = 0, 1, ...,2—1. A digraph G is strongly connected if 
it contains a directed path from every vertex to every other vertex (and thus also back to itself). 
A digraph G is root- connected if it contains a node fc, called the root, from which there is a path 
to every other vertex (but not necessarily back to itself). A digraph G is weakly connected if it 
contains an undirected path between any two of its vertices. For an undirected graph G, all these 
notions become equivalent and are simply summarized by the term connected. For G representing 
interconnections in a network of agents, clearly coordination can only take place if G is connected. 
If this is not the case, coordination will only be achievable separately in each connected component 
of G. A more interesting discussion of connectivity arises when the graph G can vary with time. 
Before discussing this case, the following summarizes some spectral properties of the Laplacian 
that are linked to the connectivity of the associated graph. 

Properties (Laplacian): Consider the out-Laplacian L^°' of digraph G. 

(a) All eigenvalues of have nonnegative real parts. 

(b) If G is strongly connected, then is a simple eigenvalue of L^°\ 

(c) Expression x T Lx, with x G WL N , is positive semidefinite if and only if G is balanced. 
If G is undirected, the Laplacian L has the following properties. 

(d) L is symmetric positive semidefinite. 
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(e) The algebraic and geometric multiplicity of as an eigenvalue of L is equal to the number 
of connected components in G. 



In a coordination problem, interconnections among agents can vary with time, as some links 
are dropped and others are established. In this case, the communication links are represented by 
a time-varying graph G(t) in which the vertex set V is fixed (by convention), but edges £ and 
weights A can depend on time. All the previous definitions carry over to time- varying graphs; 
simply, each quantity depends on time. To prevent edges from vanishing or growing indefinitely, 
the present paper considers S-digraphs, for which the elements of A(t) are bounded and satisfy 
the threshold ajk(t) > 5 > V(j, k) G £ (t), for all t. In addition, in continuous-time G is assumed 
to be piecewise continuous. For (S-digraphs G(i), it is intuitively clear that coordination may be 
achieved if information exchange is "sufficiently frequent" , without requiring it to take place all the 
time. The following definition of "integrated connectivity over time" can be found in [2| 1 1 T |. ITSl . f3T] . 

Definition 8.2: (from |17l 118] ) In discrete-time, for a S-digraph G(V, £(t), A(t)) and some con- 
stant T G Z>o, define the graph G(V, £{t), A(t)) where £(t) contains all edges that appear in 
G(r) for t G [t, t + T] and ctjk(t) = X)t=T a jk( T )- Similarly, in continuous-time, for a 5-digraph 
G(V,£(t),A(t)) and some constant T G tt>o 7 define the graph G(V, £{t), A(t)) by 



Then G(<) is said to be uniformly connected over T if there exists a time horizon T and a vertex 



The following graphs are regularly used in the present dissertation. 

• The (equally weighted) complete graph is an unweighted, undirected graph that contains an 
edge between any pair of vertices. 

• An undirected ring or cycle graph on N > 1 vertices is equivalent to an undirected path 
containing all vertices, to which is added an edge between the extreme vertices of the path. 
Similarly, a directed ring or cycle graph on TV > 1 vertices is equivalent to a directed path 
containing all vertices, to which is added an edge from the last to the first vertex in the path. 

• An undirected tree is a connected undirected graph in which it is impossible to select a 
subset of at least 3 vertices and a subset of edges among them to form an undirected cycle. 
A directed tree of root k is a root-connected digraph of root k, in which every vertex can be 
reached from k by following one and only one directed path. 

In a directed tree G, the (unique) in-neighbor of a vertex j is called its parent and its out- 
neighbors are its children. The root has no parent, and the vertices with no children are 
called the leaves. This can be carried over to an undirected graph after selecting an arbitrary 
root. 
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